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ABSTRACT 

Using instructional variables identified by the 
literature as important in predicting classroom achievement, a 
bi-polar^ rating scale was designed to assess the structure of 
instruction in resource rooms. The data for 158 elementary school 
children in four school districts were analyzed. The scale evidenced 
good reliability, both in terms of inter-observer agreement and 
internal consistency measures. Factor analysis of the scale 
identified one factor consisting of 9 of the 12 scale variables. 
Teacher use of instructional structure and implications for 
educational practice are discussed. (Author); 
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Abstract 

Using instructional variables identified by the literature as 
important in predicting classroom achievement, a bi-polar rating scale 
was designed to assess the structure of instruction in resource rooms. 
The data for 158 elementary school children in four school districts 
were analyzed. The scale evidenced good reViability, both in terms of 
inter-observer agreement and internal consistency measures. Factor 
analysis of the scale identified one factor consisting of 9 of the 12 
scale variables. Teacher use of instructional structure and 
implications for educational practice are discussed. 



The Structure of Instruction Rating Scale (SIRS): 
Development and Technical Characteristics 

The construct of classroom structure and its relationship to 
direct instructional procedures, academic engaged time, and a 
student's learning rate has emerged as an important variable in 
research in the field of educational psychology (Fisher, Berliner, 
Filby, Marliave, Cahen, & Dishaw, 1980; Stevens & Rosenshine, 1981). 
Stated more broadly, several key variables seem to coalesce or 
interact that determine effective teaching practices for regular and 
special education teachers. The concern for delimiting effective 
teaching practices for special education students has become even more 
important, since many of these students have a prior history of 
failure in academic settings. Most notably, the recent introduction 
of ditect instructional practices based on a behavioral model of 
teaching appears most effective and promising for teachers of special 
education students and those in inner cities (Cooley & Leinhardt, 
198^^: Gersten, Carnine, Zoref , , & Cronin, 1981; Stevens & Rosenshine, 
1981; Zoref, 1981). 

The hallmark of a direct instructional model is that it relies on. 
empirically testable and proven experimentally-based instructional 
procedures; modeling, prompting, shaping, and the use of reinforcement 
schedules are among the most commonly used techniques selected from 
the behavioral armamentarium (Becker, Engelmann, & Thomas, 1973). 
Recently, Starlin (1979) pinpointed four effective teaching practices 
for reading: (a) demonstrating the desired performance, (b) directly 
practicing the behavior, (c) delivering positive feedback, and (d) 
adjusting the curriculum to maxmimize learning. These tactics and 
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others employed by teachers (e.g., controlled practice that focuses on 
convergent questions, increased use of direct teacher questions, 
pr'oviding praise for correct answers as well as correction for 
incorrect answers, and monitoring independent seat work practice) have 
been shown to be effective instructional tactics that relate 
significantly to student achievement (Stevens & Rosenshine, 1981). 
Moreover, the frequency of correct answers has been shown to correlate 
quite highly with student learning as well as pacing of the 
instructional lesson (Fisher et al., 1980; Gersten, 1981; Stevens & 
Rosenshine, 1981). 

Consistent with these research findings on student learning is an 
emphasis on the direct practice of behavior(s) by the students across 
various subjects such as reading and mathematics (Borg, 1980; Starlin, 
19/9). Put simply, students must be given the opportunity (time) to 
practice and engage directly in the learning process. A major finding 
of a six-ye/ir research project funded by the National Institute for 
Education was that student academic achievement is correlated 
positively with the amount of relevant engaged time the student spends 
in reading and mathematics (Borg, 1980; Fisher et a1., 1980). Further 
support for the positive relationship between student achievement and 
academic engaged time also has been documented by Graden, Thurlow, and 
Ysseldyke (1982). 

Central to the delivery of instruction is the way in which the 
classroom environment is structured by the teacher. Teachers vary 
considerably in the value they place on providing instruction on 
academic t-isks. It has besn suggested that teachers with "high 
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academic press" may provide more opportunity for the student to engage 
in academic tasks (Fisher et al., 1980, p. 11). Miller (1980) 
described the relationship between the constructs of classroom 
structure and time: "Deriving from the notion of time is the notion 
of structure. I view structure as the purposeful ordering or 
placement of people, materials, and resources in tirre" (Miller, 1980, 
p. 163). 

Thus, there appears to be evidence that the degree of structure 
in an instructional lesson provided by a teacher will determine the 
extent to which a student engages in the practice of an academic task. 
Moreover, there is evidence that certain teaching practices are 
correlated highly with student academic achievement. The focus of the 
current research was to evaluate an observational instrument developed 
to assess the amount and typo of instruction a student received in^an 
instructional setting where teachers were trained in the use of data- 
based teaching practices. 

Method 

Development of the Scale 

A five-point rating scale that used variables considered 
necessary for effective instruction was developed. The selection of 
variables for the instrument was based on current research findings. 
The variables comprising the Structure of Instruction Rating Scale 
(SIRS), their operational definitions, and the rating scale format are 
included in Appendix A, The SIRS, as originally constituted, included 
only the first 10 variables, and only these variables were observed 
for the first data collection. The variables Oral Practice and Silent 
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Practice were added after the first data collection: thus, the SIRS 
consisted of 12 variables for the second and third dita collections. 

Two rounds of pilot data were collected, analyzed, and refined to 
develop the initial 10 variables. It should be noted that the 
operational definition of the variable Positive Consequences did not 
include teacher praise. Teacher praise was excluded because of 
evidence suggesting that the reinforcing value of teacher praise still 
needs to be empirically validated (Brophy, 1981). 

The SIRS purposely was designed to focus on the instruction a 
student receives, rather than focusing on the teacher. This approach 
was taken because it is possible, and even likely, that the behaviors 
of a teacher toward a group of students may in fact be differentially 
effective with individual students. Since instructional effectiveness 
is measured by cumulating individual achievement and since special 
education focuses on the individual, the individual instructional 
program was selected as the target for measurement rather than the 
teacher. 

Rater Training and Interobserver Agreement 

During training, raters observed and rated videotaped recordings 
of a teacher and two to three students. Two tapes of a teacher, 
judged by her associates to be highly competent, were made one week 
apart. In the first session, the teacher was instructed to conduct 
her ciass as she normally would. For the second tape, the teacher was 
asked to model what she considered to be poor teaching techniques. 
These two tapes provided examples of the extremes represented by 
ratings of 5 and 1 on the rating scale. 
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Six research assistants from the Institute for Research on 
Learning Disabilities were trained in the use of the Structure of 
Instruction Rating Scale and then allowed to practice rating the first 
tape of the "competent" teacher. After viewing the first tape, the 
observers and trainers went over the results and attempted to come to 
agreement on the "appropriate" rating for each variable on that tape. 
In order to reinforce this agreement they then'rated the second tape. 

In their description of a method for determining inter-rater 
agreement, Lawlis and Lu (1972) stated that agreement can be defined 
as exact, within one or two points. Tinsley and Weiss (1975) 
qualified this by pointing out that the decision of what standard to 
use as agreement and the rationale for this decision must be made 
prior to collecting data. Inj the current study, within one scale 
point was chosen as the level for agreement. Exact agreement on many 
dimensions of the SIRS would require observers, in many cases, to 
agree on distinctions that are very fine (sometimes varying no more 
than b%). Some precision is sacrificed in not making this 
distinction, but such precision may be of questionable value. In the 
long run, it is probably more important to differentiate between high 
and low structured instructional programs than between high and very 
high structured programs, or between low and very low structured 
programs. . • 

Counting rati ngs within one scale point as agreement, 
interobserver agreement on the original 10 variables ranged from .70 
to 1.00, with a mean interrater agreement of .84. Feedback and 
discussion following the first tape resulted in improved observer 
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reliability on the second tape, with agreements ranging from .80 to 
1.00, with a mean of .01. Mean ratings for the 10 variables on the 
two tapes are included in Table 1. 

Insert Table 1 about here 



The SIRS was used in four locations in Minnesota, and one in New 
York City. Teachers and administrators in some of the school 
districts were trained as observers since research assistants were not* 
able to collect data in all locations. The same videotapes and 
training procedure were employed; the New York raters and one of the 
four Minnesota groups reported' observer reliabilities. The raters 
trained in the Minnesota district reached an interrater agV-eement of 
.95 among themselves and .92 with the ratings of the jsix original 
observers. The New York observers achieved a mean interrater 
agreement of .85 among themselvk and .84 with the ratings of the six 

research assistants. The somewhat lower agreement figures may be due 

i 

to different, trainers, or they may be simply a consequence of 
different location. 

As O'Leary (1975) noted, one of the problems with measures of 
observer agreement is that of observer drift. Although observers may 
reach a high: initial level of agreement, that agreement tends to 
disintegrate over time as each observer, or group of observers, 
develops idiosyncratic definitions. Thus,, as recommended by O^Leary 
and others (Keller, 1980), checks on interobserver agreement were made 
four months after the Initial training. The checks Involved four of 
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the original six observers and took place in actual classroom 
settings. Checks on six students resulted in interrater aoroomonts 
for one pair of observers ranging from .75 to ,83 (X = ,01 ), and for 
the other pair ranging from .92 to 1.00 (X = •95). In addition, 
training of additional observers (all research assistants) later in 
the year allowed for "recal ibrat ion" of the original observers with 
the training tape. 
Subjects 

The subjects for all statistical analyses were .158 grade 1-8 
resource room students in four rural and suburban Minnesota school 
districts. All subjects were participants in research on the 
effectiveness of frequent data-based reading measures. The data were 
collected three times during the school year: fall (October), winter 
(February), and spring (May). 

Results 

Rel iabi1 ity 

Interrater agreement is only one. facet of reliability. Any 
measurement Instrument also must show evidence of internal consistency 
or homogeneity; that is , to what degree do all items , of the scale 
measure the same thing? Cronbach's Alpha, a measure of internal 
consistency, was chosen to assess the reliability of the SIRS. 

Data were analyzed for each of the three data collections. For 
the fall data, item-total correlations resulted in an alpha of .84 
over all 10 variables. The ratings on the 12 variables in winter 
showed somewhat lower inter-item correlations, with an alpha of .76. 
The spring data resulted in a reliability estimate of .81. 
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As can be seen in Table 2, although the i tem-tota*! correlations 
for all variables (lo' in the fall, 12 in winter and spring) generally 
were high, there was some instability among the correlations. 
Particularly, the variables Positive Consequences, Independent 
Practice, and Silent Practice showed low and inconsistent item-total 
correlations across the data collections. These data are consistent 
with the factor analysis that resulted in the omission of these latter 
three items from the scale. 



Insert Table 2 about here 



Dropping the three items from the scale resulted in stronger and 
more consistent item-total correlations, and hence a more reliable 
scale. As shown in Table 3, the remaining ni ne variables exhibited 
good to excellent inter-item correlations, resulting in alphas of .92, 
.82 and .88 for fall, winter, and' spring, respectively. Thus, the 
SIRS evidences good reliability, consistent acros.s items and over 
time. 



Insert Table 3 about here 



Factor Analysis _ I 

In order to help determine whether the 12 .variables of the SIRS 
measured the same construct or several constructs, a factor analysis 
was performed on the data _from the second data colTectlorv (N=157). 
The method chosen, principal-component analysis] makes no assumption 
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about the underlying structure of the variables, but simply identifies 
the best linear combination of variables, that is, the particular 
combination of variables that accounts for more of the variance in the 
data than any other linear combination of variables. The first 
principal component identified represents the single best combination 
of variables for this purpose, the second component the :second best 
combination that is orthogonal (uncdrrelated) to the first, and so on. 
The final solution sought in. factor analysis allows one to determine 

whether there is an underlying pattern of relationships among the 

/ 

variables such that the data may be rearranged or reduced to a smaller 
number of factors or components accounting for -these interrelations 
(Kim, 1975). 

Initial factor analysis of the SIRS revealed four factors with 
eigenvalues greater than or equal to 1.0—that is, factors that 
accounted for at least the amount of the total variance of a single 
variable. Of these factors, the first accounted for 54.8% of the 
variance, the second for 24.7%. Since these two factors alone 
accounted for almost 80% of the variability in the data, a^subsequent 
factor analysis examined only these two factors, in order to more 
clearly identify those variables loading on each factor. 

The second factor analysis resulted in all of the variables but 
three loading on the first factor (see Table 4). Two of these three. 
Independent Practice and Positive Consequences, loaded on the second 
factor; for only. Silent Practice was the variance unexplained by 
either factor. The first factor accounted for 70.3% of the variance, 
and the second factor for only 29.7% of the variance. 
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insert Table 4 about here 

The existence of a single common factor shared by 9 of the 12 
variables implies that they were measuring a single construct. Since 
this shared component accounted for 70.3% of the variance, all 
subsequent analyses treated thiese variables as one factor; the 
remaining three variables were analyzed separately. 
Teacher Use of Structure in Instruction 

Once sufficient reliabi lity and evidence of consistent factor 
structure had been established, an effort was made to determine which 
of the variables being measured were experienced most by students 
during their instructional programs. Among the nine variables 
analyzed as one factor, the moderate to high ratings at all three 
points in time indicated that these aspects of classroom structure are 
relatively well established in most resource rooms (see'Table 5). 
Standard deviations tended to be very stable over time. 



Insert Table 5 about here 



As is shown in Table 5, Corrections, Frequency of Correct 
Answers, Teacher Directed Learning, and Active Academic Responding 
were experienced most often in students' programs. At time 2, c/ver 
80% of the student programs received a rating of 4 or higher on the 
variables Corrections, Frequency of Correct Answers, and Active 
Academic Responding. It is apparent, however, that the elements of 

is 
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structure represented by Independent Practice, Positive Consequences, 
and Silent Practice were much less a part of the programs studied. 
For example, at time 2, only 26?^ of the students were observed 
participating in any form of^ token economy as part of their programs. 

For the most part, program structure remained very stable over 
time. There was an average difference of only .2 rating points 
between the highest and lowest ratings on any given variable over all 
three data collections. 

Not surprisingly, there were great differences in the amount of 
structure students received in the various resource rooms. The mean 
SIRS rating for each classroom was obtained by averaging the SIRS 
rating for the individual students in that resource room. At time 3, 
these . ' .sroom means ranged from 2.89 (over 3 students) to 4.81 (over 
6 students) and were, in fact, significantly different, £(34) = 4.63; 
£ < -.001. There were no significant differences in structure of- 
instruction as a function of curriculum, nor were there significant 
grade, level differences in structure of instruction provided ,to 
students. 

Discussion 

■■■ . / 

Few measurement devices in ^psychology have been used as widely, 
or maligned as widely, as rating scales. Despite the frequency of 
their use, and the voluminous research on their psychometric qualities 
(cf. Saal, Downey, & Lahey, 1980), the problems identified nn the 
early literature (Guilford, 1954; Thorndike, 1920) have not yet been 
laid to rest. Thus, extreme care must be taken in the development of 
a new rating scale to ensure the reliability and validity of the 
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instrument. 

The Structure of Instruction Rating Scale (SIRS) was designed to 
measure the instructional structure provided to individual students in 
the resource room. The dimensions included in the scale were chosen 
from the 'literature as those variables that seemed most likely to 
predict achievement. These variables then formed the behavioral 
definitions for the 12 items of the original rating scale. 

Of \^ prime importance in assuring th^ reliability of any 
observational instrument is achieving inter-observer agreement. If 
the scale does not evidence a high degree of inter-rater reliability, 
there is no assurance that the observers are measuring the same thing 
(Sulzer-Azaroff & Mayer, 1977). Raters were trained in the use of the 
SIRS through observation of videotapes and reached good to excellent 
levels of agreement during training. In addition,- periodic checks 
ensured the maintenance of such agreement over time. 

Additional statistical analyses confirmed the reliability and 
validity of the scale. Internal consistency estimates for the SIRS 
showed intercorrelations among the 12 dimensions high enough to prove 
scale reliability, yet not so high as to evidence halo effects 
(Keaveny & McGann, 1975), that is, the tendency of a rater to rate a 
subject in a similar manner on all dimensions. The dimensions 
represented by the SIRS variables were selected to measure a single 
construct, the structure of an instructional program; thus", factor 
analysis of the scale that identified a singl^^ construct accounting 
for the majority of the variance supports the construct validity of 
the SIRS. Other evidence supporting the construct validity of the 
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SIRS was its ability to differentiate between the amount of structure 
provided in different classrooms, and to predict achievement as 
indexed by both traditional and alternative measures (Skiba, King, & 
Deno, 1983). 

Throughout the data analysis, 9 of the 12 variables tended to 
form one construct, wtile three dimensions ( Independent Practice, 
PosUive Consequences, and Silent Practice) consistently failed to 

group with the other nine. The failure of these three variables to 

/ 

relate to the other variables of the scale is interesting both from a 
psychometric and a research viewpoint. All three variables were 
observed infrequently in students' programs and, in fact, the 
circumstances of the observations precluded observation of Independent 
Practice in a majority or cases (54%). However, the variable Positive 
Consequences may have failed to predict academic achievement or load 
on the structure factor due to the lack of its use in the classrooms. 
This finding provides important and disturbing information about the 
state of the art of token economies in resource classrooms, especially 
given extensive research findings that indicate the effectiveness of 
such systems for special populations (Kazdin, 1977; 0*Leary, Drabman, 
& Kass, 1973; Phillips, Phillips, Fixsen & Wolf, 1971; Staats & 
Butterfield, 1965). 

The failure of Silent Practice to load on either factor is more 
difficult to explain, especially given the importance attached to 
silent reading practice in the literature (Graden, Thurlow, Ysseldyke, 
& Algozzine, 1982). This failure may represent a measurement problem. 
Most of the variables are free to vary independent of each other; that 
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is, the occurrence of a behavior included in one variable does not 
preclude the observation of another SIRS variable. Silent Practice 
and Oral Practice, however , are mutually exclusive: if a student is 

reading aloud, he/she cannot be observed reading silently, and vice 

\ 

versa. This may Have reduced the amount of time available for 

observation of the variable Silent Practice, 

j 

Future researchers using the SIRS might wish to exainine^v the 
relative contributions of the Oral Practice and Silent Practice 
variables. That is, ratings should be made on each variable \ 
independently, not concurrently. Such a procedure should eliminate 
the possibility of confounding due to mutually exclusive operational 
definitions. 

A similar procedure also could be employed to provide increased 
opportunities to observe Independent Practice. In addition, future 
research might addrjess the contribution of teacher praise as a 
possible variable in program structure and its relationship to student 
achievement. Anecdotal data obtained during this study suggested that 
the students often received praise from their teachers as part of 
their instructional program. However, as previously indicated, 
students rarely participated in a toke^ economy during their 
instructional lessons. By adding teacher praise as a variable, in 
addition to student participation in tokTen economies, researchers 
should be able to ferret out the relative contribution of ' each 
dimension of these program variables in terms of their relationships 
with program structure and subsequent student achievement. 

The SIRS has been shown to be a useful research instrument from 
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the standpoint of technical adequacy and heuristics. At the same 
time, the interest shown by school administrators and school 
psychologists during data collection implies that those who are 
responsible for assessing classroom environments and for teaching 
practices also may find the instrument to be useful. Certainly, the 
construct of program structirre as discussed in this paper has 
implications for staff development with respect to changing teaching 
practices . The construct of structure and the' impl i cat ions for its 
relationship to staff development have been aptly summarized by Miller 
(1980): 

It requires a major restructuring of the classroom and a 
major reassessment of the teacher ^ role, a • role that most 
practitioners have worked long and hard to define for 
themselves. This raises staff development to another level 
of difficulty. . When presented with such j a scenario, 
teachers wi 1 l ^needt^a great deal of support to resist the 
temptation to. retreat into the familiarity of old routines, 
(p. 164) • 

Clearly, the construct of program structure and its relationship 
to time and student achievement continues to emerge as a validated 
area of important research. The research findings discussed here 
support, validate, and extend several previous research findings. 
\ Ultimately, the utility of these findings will be determined by school 
\administrators who are willing to promote staff development to foster 
effective teaching practices. 
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Table 1 

Mean Ratings for the Two Videotapes^ 

n 

\ ^ 





Tape 1 
[ exemplary leacner; 


Tape 2 

V rOOr Icav-rlcr j 


Instructional Grouping 


3.20. 


■ 1.00 


Teacher Directed Learning 


5.00 


/2.00 


Active Academic Responding 


4.40 


2.17 


Demonstration and Prompting 


4.60 


1 .00 


Control-led Practice 


4.80 


1.33 


Frequency of Correct Answers 


. 4.40 


2.17' 


Independent Practice 


5.00 


1 .00 


Corrections 


5.00. 


1 .17 


4 

Positive Consequences 


4.40 


1.00 


Pacing 


.. . 4:60 


1 :33 


Overall 




1 .42 ■ 


X 


4.54 



^Means are based upon the ratings of the six IRLD research assistants 
used in the initial SIRS training. 



/ 

/ 
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Table 2 

Corrected Item - Total Correlations for All Twelve Variables 





Fall (N=23) 


Winter (N=59) 


Spring (N=64) 


Instructional GrouDina 


• 52 


.51 


.32 


Teacher Directed Learning 

1 


.67 


.63 


.78 


Active Academic Responding 


.41 


.45 


.66 


Demonstration and Prompting 


.92 


.52 


.74 


rnntrolled Practice 


.79 


.63 


.55 




51 


.25 


.42 


Independent Practice ; 


. -.17 


.17 


.23 


1 

Corrections | 


.65 


.26 


.64 


Positive Consequences/ 
Pacing / 


.34 


. 30 


.08 


.80 


.73 


.82 


Oral Practice 




.42 


.53 


Silent Practice 




.05 


.12- 


Coefficient Alpha / 


• 84 

\ 


.76 


.81 
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Table 3 

Corrected Item - Total Correlations Dropping Three Variables 





Fall (N=59) 


Winter (N=59) 


Spring (N=64) 


Instructional Grouping 


.69' 


.51 


.41 


Teaciier-JDirected Learning 


.71 


.66 


.79 


Active Academic Responding 


.64 


.44 


.66 


Demonstration and Prompting / 




.51 


.75 


Controlled Practice / 


.73 


.60 


.54 


Frequency of Correct Ansvjers 


.66 


.33 


.47 


Corrections 


.67 


.39 


.67 


Pacing 


.84 


.70 


.81 


Oral Practice 




.55 


.61 


Coefficient Alpha 


.92 


.82 


.88 
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Table 4 

Results of Second Factor Analysis of the Twelve SIRS Variables^ 



Variable 


Factor 1 


Factor 2 


T n<i1*rijr 1"T n na 1 firnuninn 


449 


.286 


Tpa r h py- Hi K'pr "hprl 1 parninn 

1 CQ^IICI U I 1 Ck« UCU L-Cai III 11^ 


66^ 


- 129 


Ar1*i\yp Ararlpmir Rp^nnndinn 


.587 


- . 079 


npmnn«;tra ti nn and Promo ti na 


.663 ■'■ 


-.034 


rnrrhrnllpd Prrir1"frp 


.696 


.280 


Frequency of Correct Answers'^ 


.362 


-.378 


Independent Practice 


j206 


.796 


Corrections 


.552 


-.444 


Positive Consequences 


.156 


■ .390 


Pacing 


.640 


-.001 


Oral Practice 


.520 


-.032 


Silent Practice 


.-.121 


-.045 

■ £ 



^Underlined variables load most heavily on the factor. - 

"^Although this variable loaded on both factors (and in fact loaded more 

heavily on Factor 2) the decision was made to include it with the 
Factor with which it was positively correlated. 



Table 5 

Means for All Subjects on SIRS Variables 



_Fall Winter _Spring Average. 

X (SD) X (SD) X (SD) X 

Corrections , 4.07 (1.17) 4.30 (.92) 4.22 (1.10) 4.20 

Frequency of Correct Aviswers 4.03 (.86) 4.36 (.78) 4.08 (.95) 4.16 

Teacher-Directed Learning 4.03 (1.07) 4.11 (.93) 4.06 (.95) 4.07 

Active Academic Responding 3.93 (1.07) 4.19 (.99) 4.04 (1.01) 4.05 

Pacing 3.58 (1.25) 3.78 (1.07) 3.84 (1.07) 3.73 

Demonstration and Prompting 3.45 (1.27) 3.81 (1.19) 3.84 (1.16) 3.70 

Controlled Practice 3.65 (1.28) 3.60 (1.27) 3.71 (1.17) 3.65 

Instructional Grouping 3.38 (1.51) 3.46 (1.32) 3.70 (1.26) 3.51 - 

Oral Practice — 3.00 (1.28) 3.06 (1.28) 3.03 

SIRS Mean 3.77 3.85 3.84 

Independent Practice 2.28(1.19) 2.11 (1.31) 2.12(1.25) 2.17 

-Positive Consequences 1.89(1.29) 1.80(1.39) 1.72(1.30) 1.80 

Silent Practice - 2.11 (1.26) 2.19 (1.18) 1.43 
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Appendix A 



Structure of Instruction Rating Scale (SIRS) 
School: Student: 



Date: Teacher: 



Observer: Number of Students in Group:^ 

Number of observations prior to rating: 

Time observation begins: Time observation ends: 

Time allocated to reading instruction per day: 

Currirulum used for instruction: Publisher_ 



Series Level 

Instructions 

Circle the number that accurately reflects your rating for each 

variable. Only one number may be circled per variable. If you are 

unable to evaluate a certain variable, mark N/A ( not appl i cab! e) next 
to the left-hand column. 

1. Instructional Grouping 1 2 3 4 5 

2. Teacher-directed Learning .1 2 3 4 5 

3. Active Academic Responding 12 3 4 5 

4. Demonstration/Prompting 1 2 3 4 5 

5. Controlled Practice 1 2 3 4 5 

6. Frequency of Correct Answers 12 3 4 5 

7. Independent Practice 12 3 4 5 

8. Corrections 12 3 4 5 

9. Positive Consequences 1 2 3 4 5 

10. Pacing 12 3 4 5 

11. Oral Practice on Outcome 

Behavior 1 2 3 4 5 

12. Silent Practice on Outcome 

Behavior 1 2 3 4 5 
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SIRS 

Operational Defi ni tions Codebook 



Instructional Grouping 

5 - 90% or more of the instruction this student receives from the 
teacher is on an individual basis. 

1 - 10% or less of the instruction this student receives from the 
teacher is on an individual basis. 

Teacher- Directed Learning _ 

5 - Student's instruction is extremely organized, businesslike, 
and teacher is firm in direction and control of activities. 
For example, student is presented with questions, student 
has material to cover, etc. 

1 - Student's instruction is casually organized and very spon- 
taneous. Teacher is not committed to having the student work 
on a particular set of material. Instructional materials do 
not determine what activities student engages in and the les- 
sons change according to problems or mood of this student. 

Active Academic Responding '* * 

5 - The student is actively practicing the academic skills to be 
learned more than 75% of the time observed. Specifically, the 
student is engaged in oral or written responding to teacher 
questions or written material, e.g., reading aloud, answering 
■questions, writing, or computing. Student rarely is involved 
in non-academic conversations with teadher or other students 
At'te riding to the lesson without responding^ such as sitting, 
looking, listening, and/or fol lowi ng along in a book doesnot 
apply. The student must make an active, written or oral 
response. 

1 - The student is actively practicing the skills to be learned 
less than 10% of the time observed. Instructional lessons 
may be interrupted or shortened to include "process" and other 
non-academic activities, e.g., clarifying feelings, opinions, 
and working on arts and crafts. 

Demonstration and Prompting 

5 - Appropriate steps of the desired behavior to be performed are 
demonstrated for the student. Student is given an opportunity 
to practice the step(s) as teacher provides prompts for correct 
behavior that approximates or achives desired response. 

1 - Teacher attempts to teach the student a behavior without using 
demonstration and prompting techniques. 
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5 . Controlled Practice 

5 - Student's practice of material is actively controlled by 
teacher who frequently asks questions to clarify that the 
student understands what has just been demonstrated. Ques- 
tions are convergent ( single factual answer ) and the stu- 
dent's answers consistently follow the questions and are 
given teacher feedback. 

1 - Student is rarely questioned by teacher following demonstra- 
tion of new materials. Questions are more divergent (open- 
ended, several interpretations) than convergent (single factual 
answer). Student's response is not consistently followed by 
teacher feedback. The type of questions are such that several 
answers are acceptable, i.e., questions are abstract or am- 
biguous. 



Examples : 

during an oral reading session: 

the teacher frequently attempts to clarify the material with 
convergent questions ("what color hat was John wearing?"), a 
5 woul d be recorded . 

the teacher asks few'-questions , .most of which are divergent 
("What do you think/this means'^*"), a 1 would be recorded. 

/' 

the teacher asks /few convergent questions or many divergent 
questions, the appropriate rating would be a 3. 

6. Frequency of Correct Answers 

5 - Academic lessons are conducted in such a way that the difficulty 
of the material allows the student to achieve mean accuracy 
of 80% of higher. 

1 - Academic material is difficult for student, component steps 
are Targe or unsequenced, and mean accuracy for student iis 
less^ than 55%.^ - ' 

(Note: If the student has no opportunity for oral or written response 
curing the observational period, item 6 would be rated N/A - 
/not applicable, while items 3 and 5 would most likely be 
/ rated T). 

7. Independent Practice 

When engaged in independent" seatwork, the student frequently is 
monitored by, the teacher who- assists , clarifies, and praises 
the student for academic engaged tasks. ^ 

Independent seatwork is defined here as a student working on an 
assigned task for at least'5 minutes. [If no such 5-minute 
block of time is observed. Item 7 is i;ated N/A].) 



If 

a) 



b) 
c) 



/ 5 



'/ (Note : 
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1 - When student is engaged in academic seat-work activities, little 
attention is given by teacher who directs seat-work activities 
from a distance or engages in work separate from the assigned 
seat work. Teacher is generally not helpful or supportive to 
student during independent practice time. 

8. Corrections 

5 - The student's errors are consistently corrected by the teacher. 
When the student either does not respond, responds incorrectly, 
or does not respond in unison if the activity is group directed 
and requires such responding, the teacher will systematically 
attempt to correct the student by asking a simpler question, re- 
focusing student's attention to elicit correct response from the 
student or provide general rules by which to determine the 
correct answer 90% or more of the time. 

1 - Student's errors are rarely and inconsistently corrected by the 
teacher. The student responses are not systematically corrected 
Student's errors are corrected 50% or less of the time. 



For example: In oral reading this includes teacher correction of skips 
and mispronunciations, or help in sounding out hesitations 

9. Positive Consequences 

5 - Positive events (tokens, points, acti vi ties , etc. ) are given to 
the student when performing the desired behavior. When learning 
a new skill the student receives positive consequence for 
approximations of the desired behavior. Consequences are con- 
sistently received during academic training time. Praise and 
compliments, e.g., "good working, nice job," are not included 
in this definition. 

1 - Student rarely receives positive consequences for academic work. 
When student receives consequences they usually are for social 
behavior, rather than for behaviors occurring under systematic 
academic training. 

10. Pacing 

5 - The pace of the lesson is rapid, providing many opportunities 

for response by the student. As a result, attention is high 

and off-task be'havior is low. 

1 - The pace of the lesson is slow and the. student's rate of 
responding is low. Lesson format frequently varies, is not 
highly structured, and student attention maj^ be low. 
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1 1 . Oral Practice on Outcome Behavior 

5 - Student reads aloud from context nearly all the time (85-100% 
or 12-15 min. of a 15 min, observation). 

1 - Student does not read aloud during the observation {0% of the 
time). 

(Note: Reading aloud for measurement purposes should not be considered 
when rating this variable, Reading in context is defined as 
reading phrases, sentences, paragraphs, or story selections,) 



Examples: 

If the student is reading isolated words nearly the entire time, 
the appropriate rating is a 3. 

If the student is reading aloud from a text about half the time, 
a 3 would be recorded. 

12. Silent Practice on Outcome Behavior 

5 - Student reads silently from context nearly all the time (85-100% 
or 12-15 min. of a 15 min. observation). 

1 - Student does not read silently during the observation (0% of 
the time). 

(Note: Reading in context is defined as the same as #11. The examples 
of #11 are the same for #12, with silent reading.) 



33 



PUBLICATIONS 



Institute for Research on Learning Disabilities 
University of Minnesota 



The Institute Is not funded for the distribution of Its publications. 
Publications may be obtained for $3.00 per document, a fee designed to 
cover printing and postage costs. Only checks and money orders .payable 
to the University of Minnesota can be accepted. All orders must be pre- 
paid. 

Requests should be directed to: Editor, IRLD, 350 Elliott Hall; 
75 East River Road, University of Minnesota, Minneapolis, MN 55455. 

Ysaeldyke, J. E. Assessing the learning disabled youngster; The state 
of the art (Research Report No. 1). November, 1977. 

Ysseldyke, J. E., & Regan, R. R. Nondiscriminatory assessment and 
decision making (Monograph No. 7). February, 1979. 

Foster, G., Algozzine, B. , & Ysseldyke, J. Susceptibility to stereo- 
typic bias (Research Report No. 3). March, 1979. 

Algozzine, B. An analysis of the dlsturblngness and acceptability of 

behaviors as a f unction of diagnostic label (Research Report No. 4). 
March, 1979. ^ 

Algozzine, B., & McGraw, K. Diagnostic testing In mathematics; An 
extension of the PIAT ? (Research Report No. 5). March, 1979. 

Deno, S. L. A direct observation approach to measuring classroom 
behavior; Procedures and application (Research Report No. 6). 
April, 1979. 

\^ ^ 

Ysseldyke, J. E., & Mlrkln, P. K. Proceedings of the Minnesota round- 
table conference on assessment of learning disabled children 
(Monograph No. 8). April, 1979. 

• . \ 

Somvaru, J. P. A new approach to the assessment of learning disabilities 
(Monograph No. 9). April, 1979. \ 

Algozzine, B. , Forgnone, C, Mercer, C. D., & Tirlfllettl, J. J. Toward 
defining discrepancies for specific learning disabilities; An 
analysis and alternatives (Research Report No. 7) . June, 1979. 

Algozzine, B. The disturbing child; A valldatlo\ report (Research 
Report No. 8). June, 1979. 



Note: Monographs No. 1-6 and Research Report No. 2 aife not available 
for distribution. These documents were part of the Institute's 
1979-1980 continuation proposal, and/or are out of print. 



34 



Ysseldyke, J. E., Algozzine, B. , Regan, R., & Potter, M. Technical 
adequacy of tests used by professionals In simul ated decision 
making (Research Report No. 9). July, 1979. 

Jenkins, J. R. , Deno, S. L., & Mlrkln, P. K. Measuring pupil progress 
toward the least restrictive environment (Monograph No. 10). 
August, 1979. 

Mlrkln, P. K., & Deno, S. L. Formative evaluation In the classroom; — An 
approach to Improv in g; Instruction (Research Report No. 10). August, 
1979. 

Thurlow, M. L., & Ysseldyke, J. E. Current assessment and decision-making 
practices In model programs for the learning disabled (Research Report 
No. 11). August, 1979. 

Deno, S. L. , Chiang, B., Tlndal, G., & Blackburn, M. Experimental analysis ' 
of program components; An approach to r esearch In CSDC s (Research 
Report No. 12). August, 1979. - 

Ysseldyke,^ J. E., Algozzine, B., Shlnn, M. , & McGue, M. Similarities and 
differences between underachlevers and students labele d learning 
disabled; Identical twins with different mothers (Research Report 
No. 13). September, 1979. 

Ysseldyke, J., & Algozzine, R. Perspectives on asse ssment of learning 
disabled students (Monograph No. 11). October, 1979. 

Poland, S. F., Ysseldyke, J. E., Thurlow, M. L., & Mlrkln, P. K. Current 

assessment and decision-making practices In scho ol settings as reported 
by directors of special education (Research Report No. 14). November, 
1979. 

McGue, M., Shlnn, M., & Ysseldyke, J. Validity of the Woodcock-Johnson 

psvcho-educatlonal battery with learning disabled students (Research 
Report No. 15). November, 1979. 

Deno, S., Mlrkln, P., & Shlnn, M. Behavioral perspectives on the assess- 
ment of learning disabled children (Monograph No. 12). November, 1979. 

Sutherland, J. H. , Algozzine, B. , Ysseldyke, J. E., & Young, ,S. What 

can I say after I say LD ? CResearch Report No. 16). December, 1979. 

Deno, S. L.., & Mlrkln, P. K. Data-based lEP development; An approach 
to substantive compliance (Monograph No. 13). December, 1979. 

Ysseldyke, J., Algozzine, B., Regan, R. , & McGue, M. The Influence of 

test scores and naturally-occurring pupil characteristics on psycho- 
educational decision making with children (Research Report No. 17). 
December, 1979. 

Algozzine, B., & Ysseldyke, J. E. Decision makers' prediction of 

students' academic difficulties as a function of referral informa- 
tion (Research Report No. 18) . December, 1979. 

35 



Yaacldyke, J. E. » & Algozzine, B. Diagnostic classification decisions 
as a function of referral information (Research Report No. 19). 
January, 1980. 

Deno, S. L. , Mlrkln, P. K. , Chiang, B. , & Lowry, L. Relationships 

among simple measures of reading and performance on standardized 
achievement tests (Research Report No. 20) • January, l980f 

Deno, S. L. , Mirkin, P. K. , Lowry, , & Kuehnle, K. Relationships 

among simple measures of spelling and performance on standardized 
achievement tests (Research Report No. 21). January, 1980. 

Deno, S. , Mirkin, P. K. , & Marston, D. Relationships among simple 
measures of written expression and performance on standardized 
achievement tests (Research Report No. 22). January, 1980. 

Mirkin, P. K. , Deno, S. , Tindal, G. , & Kuehnle, K. Formative evalua- 
tion; Continued development of data utilization systems (Research 
Report No, 23). January, 1980. 

Deno, S. L. , Mirkin, P. , Robinson, S. , & Evans, P. Relationships 

among classroom observations of social adjustment and sociometric 
rating scales (Research Report No. 24). January, 1980. 

Thurlow, M. L. , & Ysseldyke, J. E. Factors influential on the psycho- 
educational decisions reached by teams of educators (Research Report 
No. 25). February, 1980. 

Ysseldyke, J. E., & Algozzine, B. Diagnostic decision making in indivi- 
duals susceptible to biasing information presented in the referral 
case folder (Research Report No. 26). ^ March, 1980. 

Thurlow, M. L. , & Greener, J. W. Preliminary evidence on information 

considered useful in instructional planning (Research Report No. 27). 
March, 1980. 

Ysseldyke, J. E., Regan, R. R. , & Schwartz, S. Z. The use of technically 
adequate tests in psychoeducational decision making (Jlesearch Report 
No. 28). April, 1980. 

Richey, L., Potter, M. , & Ysseldyke, J. Teachers* expectations for the 
siblings of learning disabled and non-learning disabled students ; 
A pilot study (Research Report No. 29). May, 1980. 



Thurlow, M. L., & Ysseldyke, J. E. Instructional planning; Information 
collected by school psychologists vs. information considered use- 
ful by teachers (Research Report No. 30). June, 1980. 

Algozzine, B. , Webber, J., Campbell, M., Moore, S., & Gilliam, J. 

Classroom decision making as a function of diagnostic labels and 
perceived competence . (Research Report No. 31). June, 1980. 

36 



Ysseldyke, J. E., Algozzine, B. , Regan, R. R. , Potter, M. , Richey, L. , 

& Thurlow, M. L. Psychoeducational assessment and decision making: 
A computer-slmulatejd Investigation (Research Report No. 32). 
July, 1980. I 

Ysseldyke, J. E., Algozzlne, B. , Regan, R. R. , Potter, M. , & Richey, L. 
Psychoeducational assessment and decision making! Individual pase 
studies (Research Report No. 33). July, 1980. 

Ysseldyke, J. E., Algozzlne, B. , Regan, R. , Potter, M. , & Richey, L. . 
Technical supplement for computer-simulated Investigations of the 
psychoeducational assessment and decision-making process . (Research 
Report No. 34). July, 1980. ^ 

Algozzlne, Bi , Stevens, L., Costello, C, Beattle, J., & Schmid, R. 

Classroom perspectives of LP and other special education teachers 
(Research Report No. 35). July, 1980. 

Algozzlne, B., Slders, J., Slders, J., & Beattle, J.* Using assessment 

ij iformatlon to plan reading Instructional programs; Error analysis 
a nd word attack skills (Monograph No. 14). July, 1980. 

Ysseldyke, J., Shlnn, M. , & Epps, S. A comparison of th e WISC-R and 

the Woodcock-Johnson Tests of Cognitive Ability (Research Report* ^ 
No. 361. July, 1980. 

i 

Algozzlne, B., & Ysseldyke, J. E. An analysi s of difference ^core relia- 
bilities on three measures with a sample of low achieving y oungsters 
(Research Report No. 37). August, 1980. 

Shlnn, M. , Algozzlne, B., Marston, D. , & Ysseldyke, J. A theoretical 
analysis of the performance of learning disabled stude nts on the 
Woodcock-Johnson Psycho-Educational Battery (Research Report No. 38). 
August, 1980. 

Richey, L. S. , Ysseldyke, J., Potter, M. , Regan, R. R. , & Greener, J. 

Teachers* attitudes and expectations for siblings o f learning dis- 
abled chll^dren (Research Report No. 39). August, 1980. 

Ysseldyke, J. E., Algozzlne, B., & Thurlow, M. L. (Eds.). A naturalistic 
Investigation of special education team meetings (Research Report No. 
40). August, 1980. 

Meyers, B., Meyers, J., & Deno , S. Formative evaluation and teacher deci- 
sion making; A follow-up Investigation (Research Report No. 41). 
September, 1980. 

Fuchs, D., Garwlck, D. R., Featherstone , N., & Fuchs , L, S. On the ,deter- 
mlnants and prediction of handicapped children' 3 differential test 
perforroance with familiar and unfamiliar examiners (Research Report 
No. 42). September, 1980. 



37 



Alg0252lne, B., & Stoller, L. Effects of labels and competence on 
teachers' attributions for a student (Research Report No. A3). 
September, 1980. 

Ysseldyke, J. E., & Thurlow, M. L. (Eds.). The special education 
assessment and declslon-'maklng process; Seven case studies 
(Research Report No. AA) . September, 1980. 

Ysseldyke, J. E., Algozzlne, B., Potter, M. , & Regan, R. A descriptive 
study of students enrolled In a program for the severely learning 
disabled (Research Report No. A5) . September, 1980. 

Marston, D. Analysis of subtest scatter on the tests of cognitive 
ability from the Woodcock-Johnson Psycho-Educational Battery 
(Research Report No. A6) . October, 1980. 

Algozzlne, B., Ysseldyke, J. E., & Shlnn, M. Identifying children with 
learning disabilities; When Is a discrepancy severe? (Research 
Report No. A7) . November, 1980. 

Fuchs, L., Tlndal, J., & Deno, S. Effects of varying Item domain and 
sample duration on . technical characteristics of dally measures 
In reading (Research Report No. A8) . January, 1981. 

Marston, D., Lowry, L., Deno, S., & Mlrkln, P. An analysis of learning 

trends In simple measures of reading, spelling, and written expression 
A longitudinal study (Research Report No. A9) . January, 1981. 

Marston, D., & Deno, S. The reliability of simple, direct measures of 
written expression (Research Report No. 50). January, 1981. 

Epps, S., McGue, M., & Ysseldyke, J. E. Inter-judge agreement In classi- 
fying students as learning disabled (Research Report No. 51). Feb- 
ruary, 1981. 

Epps, S., Ysseldyke, J. E., & McGue, M. Differentiating LD and non-LD 
students; "I know one when I see one" (Research Report No. 52). 
March, 1981. 

Evans, P. R. , & Peham, M. A. S, Testing and measurement In occupational 
therapy. A review of current practice with special emphasis on the 
Southern California Sensoiry Integration Tests (Monograph No. 15). 
April, 1981. , 

Fuchs, L. , Wesson, C, Tlndal, G., & Mlrkln, P. Teacher efficiency In 

continuous evaluation of lEP goals (Research Report No. 53). June, i 
1981. 

Fuchs, D., Featherstone, N., Garwlck, D. R., & Fuchs, L. S. The Impor- 
tance of situational factors and task demands to handicapped chil- 
dren's test performance (Research Report No. 5A) . June, 1981. 



38 



Tlndal, G. , & Deno, S. L. Dally measurement of reading; Effects of 

varying the size of the Item pool (Research Report No. 55). July, 
1981. 



Fuchs, L. S., & Deno, S. L. A comparison of teacher judgment, standard- 
ized tests, and currlculum-'based approaches to reading placement 
(Research Report No. 56). August, 1981. 

Fuchs, L., & Deno, S. The relationship between curriculum-based mastery 
measures and standardized achievement tests In reading (Research 
Report No. 57). August, 1981. 

Chrlotenson, S., Graden, J., Potter, M., & Ysseldyke, J. Current research 
on psychoeducatlonal assessment and decision making; Implications 
for training and practice (Monograph No. 16). September, 1981. 

Chrlstenson, S. , Ysseldyke, J., & Algozzlne, B. Institutio nal constraints 
and external pressures Influencing referral decisions (Research 
Report No. 58). October, 1981. 

Fuchs, L., Fuchs, D., & Den'o',**S." Reliability and vali dity of curriculum- 
based informal reading Inventories (Research Report No. 59) . Octo- 
' ber, 1981. . ' 

Algozzlne, B., Chrlstenson, S., & Ysseldyke, J. Probabilities associated 
with the referral-to-placement process (Research Report No. 60). 
November, 1981. 

Tlndal, G., Fuchs, L. Chrlstenson, S., Mlrkin, P., & Deno, S. The rela- 
tionship between student achievement and teacher assessment of short- 
or long-term goals (Research Report No. 61). November, 1981. 

Mirkln, P., Fuchs, L., Tlndal, G., Chrlstenson, S., & Deno, S. The effect 
of lEP monitoring strategies on teacher behavior (Research Report No. 
657! December, 1981. ~ v 

Wesson, C, Mirkln, P., & Deno, S. Teachers* use of self Instructional 
materials for learning procedures for developing and monitoring 
progress on lEP goals (Research Report No. 63). January, 1982. 

Fuchs, L., Wesson, C, Tlndal, G., Mirkln, P., & Deno, S. Instructional 
changes, student performance, and teacher preferences; The effects 
of specific measuremetit and evaluation procedures (Research Report 
No. 64). January, 1982. . 

Potter, M., & Mirkln, P. Instructional planning and implementation 
practices of elementary and secondary resource room teachers; 
Is there a difference ? (Research Report No. 65). January, 1982. 



3D 

o 

ERIC 



Thurlow, M. L., & Ysseldyko, J. E. Teachers* belief 8 about LP fltiidenta 
(Research Report No, 66). January, 1982. 

Graden, J., Thurlow, M. L., & Ysseldyke, J. E. Academic engaged time 
and, Its relationship to learninf^; A review of the literature 
(Monbgraph No. 17). January, 1982. 

King, R., Wesson, C. , & Deno, S. Direct and frequent measurement of 
1 student performance ; Does It take too much time ? (Research 
y Report No. 67). February, 1982. 

Greener, J.^ W.,\ & Thurlow, M. L. Teacher opinions about professional 
education training programs (Research Report No. 68). March, 
1982. r 



Algozzlne, B., & Ysseldyke, J. Learning disabilities as a subset of 
school failure; The oversophlstlcatlon of a concept (Research 
Report )^o. 69). March, 1982. 

Fuchs, D., Zern, S., & Fuchs, L. S. A microanalysis of participant 
behavior In familiar and unfamiliar test conditions (Research 1 
Report No. 70). March, 1982. \ 

Shlnn, M. R. , Ysseldyke, J., Deno, S., & Tlndal, G. A comparison of 
psychometric and functional differences between students labeled 
learning disabled and low achlervlng^ (Research Report No. 71). 
March, 1982. 

Thurlow, M. L/Graden, J. , ^Greener, J. W., & Ysseldyke, J. E. Academic 
responding time for LP and non-LD students (Research Report No. 
72). April, 1982./ 

Graden, J., Thurlow, M.) & Ysseldyke, J. Instructional ecology and 

academic responding time for students at three levels of teacher- 
perceived behavloral^ompetence (Research Report No. 73). April, 

1982";^ ^'""'^^^ ^ 




Algozzlne, B., Ysseldyke, J., & Chrlstenaon, S. The Influence of 
teachers* tolerances for specific kinds of behaviors' on their 
ratings of a third grade student (Research Report No. 74). 
April, 1982. 

Wesson, C, Deno, S., & Mirkln, P. Research on developing and monitor- 
ing progress on lEP goals; Current findings and Implications for 
practice (Monograph No. 18). April, 1982. 

Mirkln, P., Marston, D. , & Deno, S. L. Direct and repeated measurement 
of academic skills; An alternative to traditional screening, re- 
ferral, and Identification of learning disabled students (Research 
Report No. 75). May, 1982. 



4u 



Algozzine, B., Ysseldyke, J- , Christenson, S., & Thuirlow, M. Teachers ' 
Intervention choices for children exhibiting different behaviors 
In school (Research Report No. 76). June, 1982. 



Tucker, J., Stevens, L. J., & Ysseldyke, J. E. Learning disabilities; 
The experts^ speak out (Research Report No. 77). June, 1982. 

Thtirlow, M. L., Ysseldyke, J. E., Graden, J., Greener, J. W. , & 

Mecklenberg, C/ Academic responding time for LP students receiving 
different levels of special education services (Research Report 
No. 78). June, 1982. 

Graden, J. L., Thurliw, M. L., Ysseldyke, J- E., & Algozzine, B. Instruc- 
tional ecology and academic responding time for students In differ- 
ent reading groups (Research Report No.. 79). July, 1982. 

Mlrkln,xP. K., & Potter, M. L. A survey of program planning and Imple- 
mentation practices of LP teachers ^Research Report No. 80). July, 
1982. 

Fuchs, L. S., Fuchs, D., & Warren, L. M. Special edu cation practice 
In evaluating student progress toward goals (Research Report No, 
81). July, 1982. 

Kuehnle, K. , Deno, S. L., ^ Mlrkln, P. K. Behavioral measurement of 
social adjustment: What behaviors? What setting? (Research 
Report No. 82). July, 1982. 

Fuchs, D., Dalley, Ann Madsen, & Fuchs, L. S. Examiner familiarity and 
the relation between qualitative and quantitative Indices of ex- 
pressive language (Research Report No. 83). July, 1982. . 

Vldeen, J., Deno, S., & Marston, D. Correct, word sequences; A valid 
Indicator of proficiency In written expression (Research Report 
No. 84) . July, 1982. 

Potter, M. L. 3ppl-lc^tl!on of a decision theory model to eligibility 

and classification decisions In special education (Research Report 
No. 85). July, 1982. 

Greener, J. E., Thurlow, M. L. , Graden, J. L., & Ysseldyke, J. E. The 

educational environment and students' responding times as a function 
of students* teacher-perceived academic competence (Research Report 
No. 86). August, 1982. 

/ 

Deno, S., Marston, D. , Mlrkln, P., Lowry, L., Slndelar, P., & Jenkins, J- 

The use of standard tasks to measure achiev ement in reading, spelling, 
and written expression; A normative and developmental study (Research 
Report No. 87). August, 1982. 

Sklba, R., Wesson, C, & Deno, S. L. The effects of training teachers in 
the use of formative evaluation in reading: An experimental-control 
comparison (Research Report No. 88). September, 1982. . 



Mar 8 ton, D., Tindal, G. , fit Deno, S. L. Eligibility for learning disa- 
bility services: A direct and repeated measurement approach 
(Research Report No. 89). September, 1982. 

Thurlow, M. L., Ysseldyke, J. E. , & Graden, J. L. LP students* active 
academic responding in regular and resource classrooms (Research 
Report No. 90). September, 1982. 

Ysseldyke, J. E., Chrlstenson, S., Planta, R. , Thurlow, M. L., & Algozzlne, 
B. An analysis of current practice in referring students \for psycho- 
educational evaluation; Implications for change (Research! Report No. 
91) . October, 1982. \ 

Ysseldyke, J. E., Algozzlne, B., & Epps, S. A logical and empirical 

analysis of current practices in classifying students as handicapped 
(Research Report No. 92). October, 1982. 

Tindal, G., Marston, D., Deno, S. L., & Germann, G. Curriculum differ- 
ences in direct repeated measures of reading (Research Report No. 
93) . October, 1982. 

Puchs, L.S., Deno, S. L. , & Marston, D. Use of aggregation to improve 
the reliability of simple direct measures of academic performance 
(Research Report No. 94). October, 1982. 

Ysseldyke, J. E., Thurlow, M. L., Mecklenburg, C., & Graden, J. Observed 
changes in instruction and student responding as a function of 
referral and special education placement (Research Report No. 95). 
October, 1982. 

Fuchs, L. S., Deno, S. L., & Mlrkln, P. K. Effects of frequent curricu- 
lum-based measurement and evaluation on student achievement and 
knowledge of performance; An experimental study (Research Report 
No. 96). November, 1982. 

Fuchs, L. S., Deno, S. L., & Mlrkln, P. K. Direct and frequent measure- 
ment and evaluation; Effects on instruction and estimates of 
student progress (Research Report No* 97). November, 1982« 

Tindal, G., Wesson, C., Germann, G., Deno, S. L., & Mlrkln, P. K*. The 
Pine County model for special education delivery; A data-based 
system (Monograph No. .19). November, 1982. 

Epps, S., Ysseldyke, J. E., & Algozzlne, B. An analysis of the conceptual 
framework underlying definitions of learning disabilities (Research 
Report No. 98). November, 1982. 

Epps, S., Ysseldyke, J. E., & Algozzlne, B. Public-policy Implications 
of different definitions of learning disaBilities (Research Report 
No. 99). November, 1982. 

Ysseldyke, J. E., Thurlow, M. L., Graden, J. L., Wesson, C., Deno, S. L., 
& Algozzlne, B., Generalizations from five years of research on 
assessment and decision making (Research Report No. 100). November, 
1982. 

42' ^ • . 



Marston, D., & Deno, S. L. Measuring academic progress of students with 
learning difficulties: A comparison of the semi-logarithmic chart 
and equal interval graph paper (Research Report No. 101). November, 
1982. 

Beattie, S., Grise, P., & Algozzine, B. Effects of test modifications 
on minimum competency test performance of third grade learning 
disabled students (Research Report No. 102). December, 1982 

Algozzine, B . , Ysseldyke, J. E., & Christenson, S. An analysis of the 
incidence of special class placement; The masses are burgeoning 
(Research Report No. 103). December, 1982. 

Marston, D., Tindal , G., & Deno, S. L. Predictive efficiency of direct, 
repeated measurement: An analysis of cost and accuracy in classi- 
fication (Research Report No. lOA) . December, 1982. 

Wesson', C. , Deno, S., Mirkin, P., Sevcik, B., Skiba, R. , King, R. , 

Tindal, G., & Maruyama, G. Teaching structure and, student achieve- - 
ment effects of curriculum-based measurement: A causal (structural) 
analysis (Research Report No. 105). December, 1982. 

Mirkin, P. K., Fuchs, L. S., & Deno, S. L. (Eds.). Coasiderat ions for 
des igning a continuous evaluation system: An integrative review 
(Monograph No. 20). December, 1982. 

Mariiton, D., & Deno, S. L. Implementatio n of direct and repeated 
measurem ent i n the school s etting (Research Report No. 106). 
December,' 1982. 

Deno, S. L., King, R., Skiba, R., Sevcik, B., & Wesson, C- The structure 
of instruction rating scale (SIRS) : Development and technical 
characteristics (Research Report No. 107). January^ 1983. 



43 



